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You Can Lead Students to Water, but You Can’t Make Them 
Think: An Assessment of Student Engagement and Learning 
through Student-Centered Teaching 
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Abstract: The current project conducted an assessment of specific, directed use of 
student-centered teaching techniques in a criminal justice and criminology 
research methods and statistics class. The project sought to ascertain to what extent 
these techniques improved or impacted student learning and engagement in this 
traditionally difficult course. Overall, the results indicate a modest but notable 
increase in student engagement and subsequent learning. Results provide empirical 
evidence that students were significantly engaged with the course and therefore 
benefited from these pedagogical techniques. 
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Introduction 

Pedagogical research has become a burgeoning field in many academic disciplines as more and 
more teachers have wanted to know how to improve student-learning outcomes (Albers, 2007; 
Slunt & Giancarlo, 2004). However, there are some disciplines that have explored the scholarship 
of teaching and learning more deeply than others. The academic discipline of Criminal Justice and 
Criminology remains relatively untouched by deeper exploration into this realm of research (Stack, 
2007). Instructors within this discipline acknowledge the technological innovations that allow for 
more engaging and interactive teaching methods (Davis, et al., 2014), however, these 
improvements have largely focused on experiential learning, service-learning, and the use of 
internships (Davis, et al., 2014). Team-Based Learning is also a technique that has gained 
popularity in this discipline, but increased class sizes and reduced resources are likely a culprit as 
to why this pedagogical technique is not used more frequently (Stamatel, et al., 2013). Although 
there are likely many who are employing innovative teaching techniques, they are not necessarily 
being assessed in a research environment, nor are they necessarily being published. This paper 
intends to add to the growing body of literature on the scholarship of teaching and learning as well 
as pave the way for further pedagogical research specifically within the discipline of Criminal 
Justice and Criminology. 
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The purpose of pedagogical research is to identify the best practices that improve student¬ 
learning outcomes (Haggis, 2009). This requires defining those outcomes and employing one or 
more techniques that can be empirically assessed as impacting those outcomes. The traditional 
teacher-oriented model poses a risk to courses that would benefit from greater engagement 
(Gordon, et al., 2009). In these traditional classrooms, the well-organized and self-motivated 
students will typically do very good work; there will always be students who may choose not to 
engage at all and subsequently fail the course, but the rest will fall largely in the middle as 
“average” (Albers, 2007). Although this teaching-centered method has been employed for ages, 
only in the last several years have teachers begun to break down these barriers and employ 
alternative techniques that have a more lasting effect on student-learning outcomes. Further, 
research suggests that even large-sized classes can benefit from non-traditional, student-centered 
approaches (Gordon, et al., 2009). 

The increased use of student-centered learning has produced a variety of techniques to 
include the three specifically addressed in the current project: Team-Based Learning, Incentive- 
Based Learning and Flipped Classroom. Briefly defined, these pedagogical techniques 
respectively employ facilitated group work, the use of positive-reinforcement for work, and using 
the classroom for more direct interaction as a result of directed work outside of the classroom. As 
mentioned previously, it is also important to define the student-learning outcomes that any 
technique is hoping to impact. An increase in course grades or doing well on examinations are 
commonly used measures (Haggis, 2009), but there are others such as student engagement, self- 
assessed learning, and other objective and subjective measures of learning. The concept for this 
project was derived from an observation that the average criminal justice student dislikes the 
research methods course and that this course is regularly outperformed by all other courses within 
the discipline. This personal observation is empirically rooted in the concept that students are 
generally apathetic about traditional learning methods (Stamatel, et al., 2013). Additionally, 
Briggs, et al. (2012) identified three concepts that specifically define apathy in research methods 
courses: Research Disinterest, Relevance Argumentation, and Math Anxiety or “DRAMA.” This 
project seeks to explore a single research question: are student-centered teaching methods effective 
at improving student engagement and learning? 

Literature Review 

Pedagogical techniques have been explored recently to help improve teaching methods and 
subsequently improve student learning (Haggis, 2009), specifically in traditionally difficult 
courses such as research methods and statistics (Sundt, 2010). There are many techniques that have 
emerged as effective, but so much of that effectiveness relies heavily upon a variety of variables 
to include (but not limited to) method of delivery, dynamics of the classroom, demographics of 
the students, nature of the academic discipline and school program, and episodic incidents that 
cannot be accounted for during any given class (Haggis, 2009). These approaches are often 
assessed for effectiveness on a variety of student learning outcomes such as improved final exam 
scores, final grades, and self-assessed learning (Grant & Green, 2013). Since it appears that these 
techniques are generally fmitful, this study proffers the idea that the use of any student-centered 
pedagogical approaches will improve learning outcomes and student engagement, even in a 
traditionally difficult course. Although this study focused on the pedagogical approaches that 
primarily utilized elements of team-based learning (TBL), flipped classroom, and incentive-based 
learning (IBL), these were not specifically assessed for effectiveness, but instead the use of any 
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student-centered pedagogical approach, as a whole, is what ultimately impacted the desired 
learning outcome, specifically student engagement. 

Student-Centered Learning 

Student-Centered Learning (SCL) typically acknowledges the more active role a student plays in 
their own learning (Judi & Sahari, 2013). Oblinger and Maruyama (1996) identified concepts that 
focus on students’ ability to actively seek out resources available to them for learning while 
simultaneously teachers facilitate and employ teaching methods that encourage the use of these 
resources (Asoodeh, et al., 2012). Early SCL typically relied upon methods such as cooperative 
learning, critical thinking and dedicated group assignments (Felder & Brent, 1996). Building upon 
these foundations both classrooms used in the current study utilized a form of team-based learning 
(TBL), more commonly known as “group work.” This approach has proven effective in many 
capacities as it is generally recognized that students who work in teams or groups will typically 
outperform students who work individually (Nicoll-Senft, 2009). Additionally, TBL, when used 
correctly, can outperform the use of the traditional lecture (Jafari, 2014). 

TBL facilitates an active learning environment and the approach appears to considerably 
improve student cooperation, preparation, and a foundation for common-sense thinking that leads 
to improved critical decision-making (Stamatel, et al., 2013, Gullo, et al., 2015). Despite some of 
the common perceptions of group work from students (e.g., unwillingness to work with others, 
feeling that only one person will do all of the work, difficulty in scheduling time to meet, etc.), 
there is evidence that suggests many students ultimately enjoy group work because they can 
collaborate with others, divide the workload into more manageable pieces, and work toward a 
common goal, mimicking many workplaces (Fearon, McLaughlin, & Eng, 2012). TBL facilitates 
group work in a way that utilizes best practices of both individual and cooperative learning 
techniques (Jafari, 2014). It is the directed facilitation that sets this apart from other forms of group 
work and increases the likelihood of student engagement (Gullo, et al., 2015). Additionally, a 
major benefit of TBL is that it can be employed in combination with a variety of other student- 
centered teaching techniques, as is the case in the current project. 

To achieve the desired outcome of engaging the students more with the material to facilitate 
better learning, in addition to TBL, the current project also utilized variations of other pedagogical 
techniques; specifically, incentive-based learning (IBL) and flipped classroom. IBL is inspired by 
the use of positive reinforcement for good work, ideally, the use of incentives should motivate and 
inspire better work, where students compete not with each other but against deadlines and 
facilitated challenges. Used as a pedagogical technique, it is the use of incentives to encourage 
work that is above and beyond in some way, either in substance and/or in efficiency in completion 
(Hout, et al., 2012). As such, an ancillary effect of the use of incentives is that they may inspire 
faster work, but not necessarily better work. In other words, it may inspire a competitive 
environment, but not necessarily one more conducive to learning. 

From a behaviorist perspective, the use of incentives for learning is a balance between 
providing motivational incentives but not necessarily a bribe (Astroth, 1994). Further, a brief 
review of psychological research shows the “Skinnerian” approaches of applying extrinsic 
incentives does not necessarily overcome the value of natural intrinsic motivation (Grant & Green, 
2012). Hout, et al. (2012) found a more reliable way to measure the effectiveness of incentives 
may be to focus on low-stakes incentives, that is, those that would not increase student motivation 
in an inflated manner. Tests are a commonly used incentive approach, yet may naturally contradict 
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students’ intrinsic motivations to learn because they are considered a high-stakes incentive (Hout, 
et al., 2012). Students may focus too heavily on the reward (the grade), ignore the original intent 
to leam and subsequently default to avoiding the potential punishment: a poor grade (Grant & 
Green, 2012). 

In general, the use of any “threshold grading” may not be an accurate measure of learning 
or mastery of the material. Grant and Green (2012) studied the effectiveness of using pre¬ 
determined grade thresholds, which had been supposedly validated as indicative of mastery of the 
material, and ultimately found that they did not produce any actual predictive grade performance. 
In other words, despite an understanding that students knew what it took to get a certain grade 
level, there was no evidence that it motivated students to perform any better. Babcock (2010) also 
found the use of incentives indicated that the teaching method may support the incentive more so 
than student motivation. On the other hand, when grading relied more on commonly achieved self- 
and peer-evaluations, fluctuations based upon the norms established by student groups were more 
apparent (Grant & Green, 2012). 

This indicates that a more self-defined mastery of material from the student perspective led 
to greater achievement. Benvenuto (2001) also assessed this structure using a “maximum 
incentive, minimum discipline” model in a chemistry course and looked at a reward-heavy 
objective for good work, as assessed by their peers, without the fear of a punitive grade for poor 
work. Although students generally favored this method of incentive and peer-evaluation, final 
assessment revealed students did desire some form of punishment for those who did not contribute 
good work (Benvenuto, 2001). Although the literature may appear contradictory at times, it seems 
as though the use of incentives could be fruitful when the teaching method balances with self- and 
peer-defined expectations by the students, and those students have a high intrinsic motivation to 
learn. 

The use of extra credit as an incentive is meant to inspire and motivate additional work 
from the students, but is considered by some to be one of the most controversial and methods of 
motivating learning (Fuad & Jones, 2012; Pynes, 2014). Typically, the over-achieving students 
will participate in any extra credit opportunities, but they are not usually the students who actually 
need the extra credit, whereas other students rely too heavily on extra credit to save their grade 
(Pynes, 2014). In a study assessing the use of extra credit in a computer science course, Fuad and 
Jones (2012) found that using quizzes as extra credit relieved the mental stress that was associated 
with traditional test-taking perceptions, and thus became a learning tool rather than a punitive 
measure of learning (Fuad & Jones, 2012). Stack (2007) looked at the effectiveness of extra credit 
for both specific and general learning outcomes in a criminological theory course. Stack (2007) 
subsequently concluded that although the extra credit did improve grade performance on directly 
related quizzes, the overall general assessment of learning (final exam) did not indicate significant 
grade improvements. Pynes (2014) identifies many of the traditional uses of extra credit as being 
only weakly related to desired student learning outcomes, thus sabotaging attempts at properly 
motivating students. 

When used appropriately, incentives can motivate students, but may not necessarily 
improve overall student engagement. Flipped classroom takes another approach to the student 
engagement issue by requiring students to do pre-assigned homework outside of the class, so that 
the class time is used to go over the dedicated assignment and material the students independently 
covered (Novak, 2011). Students are responsible for reading any relevant course materials in order 
to complete the homework assignment. This method “flips” the lecture from within the classroom 
to outside the classroom, and the homework is covered more extensively within the class instead 
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of at home. In order for this method to be successful, the instructor must make the instructions 
very clear (Novak, 2011). 

Formica, et al. (2010) and Halloun and Hestenes (1985) found that students who are 
required to perform on a homework assignment without proper guidance failed to truly leam the 
objectives of the assignment. Formica, et al. (2010) compared two groups where one group was 
taught using the traditional class lecture-homework assignment method, while the second group 
used the flipped classroom method. The results indicated that the students under flipped classroom 
had a greater understanding of the concepts than the traditional group. The underlying reason for 
the effectiveness of the flipped classroom method is that the classroom focus is on class discussion 
and facilitated critical thinking (Slunt & Giancarlo, 2004). In a traditional lecture environment, 
students are asked to think critically all on their own without ever being given the opportunity to 
engage with each other in a critical thinking environment (Novak, 2011). 

If a technique such as flipped classroom facilitates greater engagement, then learning gaps 
can possibly be more easily identified and attended to more readily. Natarajan, et al. (2014) used 
the flipped classroom method in an algebra class to ascertain if there was a specific gain in learning 
where students can actually reach a level of perfection on the assigned material in the allotted time. 
A Chi-Square significance test (p < .05) supported the notion that if a threshold of perfection on 
an assignment is identified, students can work toward that goal, and thus any potential learning 
gaps can be immediately identified and addressed, significantly improving learning outcomes. 

Novak (2011) illustrated the positive use of web-based pre-instruction warm-ups as a 
fundamental component of flipped classroom. Closely related to the Just-in-Time Teaching 
approach, the use of modern technology allows instructors to disseminate pre-instruction materials 
to students more efficiently, and subsequently allows instructors to prepare the material “just in 
time” for class. This approach allows teachers and students to work more as a team ready to begin 
the lesson with a high level of relevance to the materials to be discussed (Novak, 2011). Further, 
this interaction allows students to have some control over their learning and to enrich the time 
spent in class. 

It is important that all student-centered learning techniques focus on clear instructions and 
consistent methods in order to achieve the best results, as well as being facilitated effectively by 
the instructor. Only a handful have been covered here, not to promote these methods specifically, 
but rather the concept that any student-centered learning approaches have greater chances at 
increasing student engagement. Thus, the current project examines the role of these student- 
centered teaching techniques and seeks to answer one question: Are student-centered teaching 
methods effective at improving student engagement and learning? From this larger research 
question, the following hypothesis is proffered: 

Hi) The use of student-centered teaching methods will improve student engagement and 

learning. 

Methods 

Participants and Procedure 

The current study was conducted in two undergraduate criminal justice and criminology research 
methodology classes from a medium to large-size, urban university. This university is located in 
the downtown area of a large city and is described as a commuter school with many nontraditional 
students - part time, older, fulltime workers. The sampling process was not random and contained 
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a total of 58 students from two separate research methods classes. Each class was instructed by 
different instructors, but met in the same semester and used the same text, The Practice of Research 
in Criminology and Criminal Justice by Bachman and Schutt (2011), and employed some form of 
team-based learning in combination with another student-centered technique (IBL or flipped 
classroom). We collected data from 58 undergraduates (22 males, 36 females). Their ages ranged 
from 18 to 55 (M=24.52). Fifty percent were seniors, 33% junior, and 17% sophomore. 
Approximately 88% of participants were full time students and 83% were employed. These 
demographics typically reflect the overall composition of the criminal justice and criminology 
department student body (Table 1). 

Table 1 

Demographic Characteristics 


Characteristic 

% 

(n) 

Gender: n=58 

Male 

37.9 

(22) 

Female 

62.1 

(36) 

Age: n=57 

Mean = 24.52 


18-21 

29.3 

(17) 

22-25 

46.5 

(27) 

26-29 

13.7 

(8) 

>30 

8.5 

(5) 

Class Standing: n=58 

Sophomore 

17.2 

(10) 

Junior 

32.8 

(19) 

Senior 

50.0 

(29) 

Full Time Student n=58 

Yes 

87.9 

(51) 

No 

12.1 

(7) 

Employed n=58 

Yes 

82.8 

(48) 

No 

17.2 

(10) 


Total Sample size N=58 


Following the work of Handelsman et al. (2005), a survey instrument of 24 behaviors and 
attitudes indicative of student engagement and learning was created. The survey instrument was 
given to the students in two Criminal Justice research methods courses during the first week of 
class and then again during the last week of class. The survey was administered during class after 
an implied consent was given. The survey sought student demographics such as age, gender, and 
class standing. Fikert-type questions were asked regarding student engagement and learning and 
were ordinal scale measures and coded 0 for “strongly disagree”, 1 for “disagree”, 2 for “agree”, 
and 3 for “strongly agree” for each question. The survey focused on two main areas: emotional 
engagement and active engagement. 

Findings and Discussion 

Exploratory Factor Analysis and Reliability 
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To measure a student’s engagement to the class, students indicated a level of agreement to the 
statements below. A factor analysis was conducted on these eight variables in order to reduce the 
data into measures that are inter-related. The factor analyses extracted two components which 
accounted for 64% of the variance. The first factor consisted of six items labeled as emotional 
engagement had 46% of the variance with a coefficient alpha of .829. The second factor consisted 
of two items labeled as active engagement and had a 20.6% of the variance with a coefficient alpha 
of .594. 


Emotional Engagement Scale: 

Like small groups 

Like to experience learning 

Motivated 

Class is fun 

Enjoy class 

Engaged 

Regression Analysis 


Active Engagement Scale: 
Attend classes 
Class is interesting 


The following analysis explores the effect of student-centered teaching on student engagement and 
learning in a college level research methods class. Using the post-course student engagement 
questionnaires, multivariate analysis was conducted to determine what attitudes may predict 
student engagement. 

To answer the question concerning which variables could predict a student’s class 
engagement, two linear regression analyses were performed. The first analysis used the Emotional 
Engagement scale as the dependent variable and the three predictor variables from the survey 
questionnaire: Class will help my career, Em a good student, and Em motivated by grades. The 
model also included the control variables of full time student, employed, age, and gender. The 
analysis showed an overall significant model (R 2 = .695; p=.000) with a multiple correlation 
coefficient of .834, indicating that approximately 70% of the variance within the sample can be 
explained by this model. Holding all other variables constant, the emotional engagement variable 
significantly influenced a student’s engagement and learning in the classroom. In particular, those 
students who felt the class helped their career, who felt they were a good student, and were 
motivated by grades were significantly more likely to be emotionally engaged in the classroom 
(Table 2). 

Table 2 

Linear Regression Model for 'Emotional Engagement” 


Dependent Variable 

Independent Variable 

B 

SE 

beta 

t 

Sig. 

Emotional Engagement 

Constant 

-3.853 

.756 


-5.098 

.000 


Full Time Student 

.067 

.274 

-.023 

-.24 

.808 


Employed 

-.032 

.226 

-.013 

-.143 

.887 


Age 

.019 

.015 

.127 

1.308 

.198 


Gender 

.014 

.181 

.007 

.080 

.937 


This class will help my career 

.327 

.114 

.286 

2.877 

.006 


I am a good student 

.442 

.188 

.252 

2.355 

.023 
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_ I’m motivated by grades _ .761 .197 .493 3.857 _ .000 

Note: R 2 = .695, df = 7, n = 51, p = .000 


The second analysis used the Active Engagement scale as the dependent variable and the 
two predictor variables from the survey questionnaire: Come to class prepared, and I like to work 
in small groups. The model also included the control variables of full time student, employed, age, 
and gender. The analysis showed an overall significant model (R 2 = .321; p=.000) with a multiple 
correlation coefficient of .566, indicating that approximately 60% of the variance within the 
sample can be explained by this model. Holding all other variables constant, the emotioned 
engagement variable significantly influenced a student’s engagement and learning in the 
classroom. In particular, those students who came to class prepared were significantly more likely 
to be emotionally engaged in the classroom. Conversely, students who like to work in small groups 
were less likely to be emotionally engaged in the classroom (Table 3). 

Table 3 

Linear Regression Model for ”Active Engagement” 


Dependent Variable 

Independent Variable 

B 

SE 

beta 

t 

Sig. 

Active Engagement 

Constant 

.157 

1.112 


.141 

.888 


Full Time Student 

-177 

.382 

-.062 

-.463 

.646 


Employed 

-.301 

.325 

-0121 

-.927 

.359 


Age 

-.015 

.020 

-.101 

-.729 

.470 


Gender 

-.118 

.253 

-.059 

-.466 

-.643 


Come to class prepared 

.812 

.206 

.520 

3.934 

.000 


Like to work in small groups 

-.536 

.228 

-.317 

-2.348 

.023 


Note: R 2 = .333, df = 6, n = 51, p = .004 


In order to improve student engagement, new approaches involving method of delivery and 
dynamics of the classroom have become effective tools (Haggis, 2009). Student centered learning 
techniques such as flipped classroom approaches and team based learning set up, offer students 
new approaches to become engaged in the classroom. The question remains, can using these 
techniques positively impact student engagement and learning in the classroom? 

It is clear that the student-centered teaching techniques assessed in this project did have a 
positive impact on student learning outcomes. Using our survey instrument, this study was able to 
look at student engagement from two perspectives: emotional engagement and active engagement. 
For instance, emotional engagement was increased when students felt the class would help their 
career, felt they were a good student, and were motivated by incentives. Looking at active 
engagement, students felt more engaged when they came to class prepared. However, the analysis 
also showed that students felt less actively engaged when they worked in small groups. 

To further our understanding of student centered learning, we looked at the comments 
made on university wide student evaluations for both courses. Within these forms we found 
supports for the statistical findings. For example, students also commented on the teaching style, 
such as the student who said “excellent teaching style and engaging class projects”, “the 
instructor provided a great classroom atmosphere with multiple avenues of learning”, and “the 
team based learning is new to me, worked out ok. ” 
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The instructors of these courses feel as though a greater learning experience was achieved 
and continue to utilize these methods in these same as well as additional courses, to a positive 
effect. Anecdotally, there has been a greater interest in student research within the criminal justice 
and criminology department, which also indicates an increased level of engagement and enjoyment 
that may be correlated with the efforts of the student-centered teaching by the faculty of the 
research methods classes. 

This project was not without limitations. First, the enrollments for each class were intended 
to be equal, but due to a classroom scheduling change one class was significantly smaller than the 
other. Second, this project would have benefitted greatly from the use of a control group, or a 
research methods class that was not utilizing any student-centered teaching techniques. This 
proved difficult as all faculty who teach this course do utilize some forms of student-centered 
teaching techniques. Thus, future study in this area would benefit from either an increase in sample 
size or the use of a control group. Finally, the measures were sufficient but much of the statistically 
significant data came from subjective, self-response measures, while the more objective measures 
fell short of achieving anything worthy of reporting in this paper. 

This project serves as evidence that a criminal justice research methods course can be just 
as engaging as any other course in the discipline, and that the previously held student disdain can 
be overcome through innovative pedagogical methods. Only three techniques were assessed here 
which allows for further research on many other student-centered pedagogical techniques. More 
research is needed specific to the criminal justice and criminology discipline. It is proffered that 
many instructors are utilizing these techniques but not many are being empirically assessed. Thus, 
a final recommendation is that the research conducted here is continued in order to encourage and 
support the instructors who continue to break down the traditional teaching barriers. 
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